Migrate flyteconnector chart wiring and runtime defaults for Flyte Connectors#7377
Migrate flyteconnector chart wiring and runtime defaults for Flyte Connectors#7377kevinliao852 wants to merge 8 commits into
Conversation
Signed-off-by: Kevin Liao <q85292542000@gmail.com>
- Added `flyteconnector` as a dependency in `Chart.yaml`. - Updated image repository and tag in `flyteconnector` README and `values.yaml` to use the latest version from GitHub. Signed-off-by: Kevin Liao <q85292542000@gmail.com>
…efaults Signed-off-by: Kevin Liao <q85292542000@gmail.com>
Signed-off-by: Kevin Liao <q85292542000@gmail.com>
There was a problem hiding this comment.
Pull request overview
This PR migrates the flyteconnector Helm chart to the new Flyte Connectors runtime and wires it into flyte-binary as a real Helm subchart dependency. It updates the connector image to ghcr.io/flyteorg/flyte-connectors:latest, switches the container command to flyte serve connector, fixes additionalVolumeMounts rendering, and clears the showcase secret data from the chart defaults.
Changes:
- Add
flyteconnectoras afile://-based subchart dependency offlyte-binary(gated byflyteconnector.enabled). - Update connector image, tag, and startup command in the chart's deployment template and defaults.
- Empty out
connectorSecret.secretDataand adjust template indentation so additional volume mounts render correctly.
Reviewed changes
Copilot reviewed 11 out of 11 changed files in this pull request and generated 8 comments.
Show a summary per file
| File | Description |
|---|---|
| charts/flyte-binary/Chart.yaml | Adds the flyteconnector subchart as a conditional Helm dependency. |
| charts/flyteconnector/Chart.yaml | New chart manifest (v0.1.10). |
| charts/flyteconnector/.helmignore | Standard helm ignore patterns for the new chart. |
| charts/flyteconnector/README.md | Auto-generated values reference for the new chart. |
| charts/flyteconnector/values.yaml | New default values: image, ports, RBAC, probes, service, etc. |
| charts/flyteconnector/templates/_helpers.tpl | Helper templates for names, labels, secret volume/mount, service port. |
| charts/flyteconnector/templates/connector/deployment.yaml | Connector Deployment with flyte serve connector command and fixed volume-mount rendering. |
| charts/flyteconnector/templates/connector/service.yaml | gRPC ClusterIP Service for the connector. |
| charts/flyteconnector/templates/connector/serviceaccount.yaml | Optional ServiceAccount with annotations and imagePullSecrets. |
| charts/flyteconnector/templates/connector/secret.yaml | Opaque Secret pseudo-manifest fed by connectorSecret.secretData. |
| charts/flyteconnector/templates/connector/rbac.yaml | Optional ClusterRole/ClusterRoleBinding for cross-namespace secret reads. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| {{- end }} | ||
|
|
||
| {{- define "flyteconnector.servicePort" -}} | ||
| {{ include .Values.ports.containerPort}} |
There was a problem hiding this comment.
Done. I've made the requested changes
| # -- Default regex string for searching configuration files | ||
| configPath: /etc/flyteconnector/config/*.yaml |
| # commonLabels Add labels to all the deployed resources | ||
| commonLabels: {} | ||
| # commonAnnotations Add annotations to all the deployed resources | ||
| commonAnnotations: {} |
| # -- Docker image for flyteconnector deployment | ||
| repository: ghcr.io/flyteorg/flyte-connectors # FLYTECONNECTOR_IMAGE | ||
| # -- Docker image tag | ||
| tag: latest # FLYTECONNECTOR_TAG |
| apiVersion: v1 | ||
| kind: Secret | ||
| metadata: | ||
| name: {{ template "flyteconnector.name" . }} | ||
| namespace: {{ template "flyte.namespace" . }} | ||
| type: Opaque | ||
| {{- with .Values.connectorSecret.secretData -}} |
There was a problem hiding this comment.
Yes, I updated this by making the Secret conditional on connectorSecret.secretData.
When secretData is empty, the chart no longer renders an empty Opaque Secret.
| {{- end}} | ||
| {{- with .Values.serviceAccount.imagePullSecrets }} | ||
| imagePullSecrets: {{ tpl (toYaml .) $ | nindent 2 }} | ||
| {{- end }} | ||
| {{- end }} |
Signed-off-by: Kevin Liao <q85292542000@gmail.com>
| apiVersion: v1 | ||
| kind: Secret | ||
| metadata: | ||
| name: {{ template "flyteconnector.name" . }} | ||
| namespace: {{ template "flyte.namespace" . }} | ||
| type: Opaque | ||
| {{- with .Values.connectorSecret.secretData -}} |
| {{- end }} | ||
|
|
||
| {{- define "flyteconnector.servicePort" -}} | ||
| {{ include .Values.ports.containerPort}} |
| name: flyteconnector | ||
| description: A Helm chart for Flyte connector | ||
| type: application | ||
| version: v0.1.10 # VERSION |
There was a problem hiding this comment.
| version: v0.1.10 # VERSION | |
| version: v2.0.0 # VERSION |
| # -- Docker image for flyteconnector deployment | ||
| repository: ghcr.io/flyteorg/flyte-connectors # FLYTECONNECTOR_IMAGE | ||
| # -- Docker image tag | ||
| tag: latest # FLYTECONNECTOR_TAG |
There was a problem hiding this comment.
use 2.3.6 for now. ghcr.io/flyteorg/flyte-connectors:py3.12-v2.3.6
|
|
||
| dependencies: | ||
| - name: flyteconnector | ||
| version: v0.1.10 |
There was a problem hiding this comment.
| version: v0.1.10 | |
| version: v2.0.0 |
Signed-off-by: Kevin Liao <q85292542000@gmail.com>
| {{- define "flyteconnector.name" -}} | ||
| {{- default .Chart.Name .Values.nameOverride | trunc 63 | trimSuffix "-" -}} | ||
| {{- end -}} |
| {{- if or .Values.connectorSecret.secretData .Values.additionalVolumeMounts }} | ||
| volumeMounts: | ||
| {{- include "connectorSecret.volumeMount" . | nindent 8 }} | ||
| {{- with .Values.additionalVolumeMounts -}} | ||
| {{ tpl (toYaml .) $ | nindent 8 }} | ||
| {{- end }} | ||
| {{- end }} |
| serviceAccountName: {{ template "flyteconnector.name" . }} | ||
| {{- if or .Values.connectorSecret.secretData .Values.additionalVolumes }} | ||
| volumes: {{- include "connectorSecret.volume" . | nindent 6 }} | ||
| {{- with .Values.additionalVolumes -}} | ||
| {{ tpl (toYaml .) $ | nindent 6 }} | ||
| {{- end }} | ||
| {{- end }} |
| annotations: | ||
| {{- with .Values.podAnnotations }} | ||
| {{- toYaml . | nindent 8 }} | ||
| {{- end }} |
| readinessProbe: | ||
| {{- with .Values.readinessProbe -}} | ||
| {{ tpl (toYaml .) $ | nindent 10 }} | ||
| {{- end }} |
| {{- define "flyte.name" -}} | ||
| {{- default .Chart.Name .Values.nameOverride | trunc 63 | trimSuffix "-" -}} | ||
| {{- end -}} | ||
|
|
||
| {{- define "flyte.chart" -}} | ||
| {{- printf "%s-%s" .Chart.Name .Chart.Version | replace "+" "_" | trunc 63 | trimSuffix "-" -}} | ||
| {{- end -}} | ||
|
|
||
| {{- define "flyte.namespace" -}} | ||
| {{- default .Release.Namespace .Values.forceNamespace | trunc 63 | trimSuffix "-" -}} | ||
| {{- end -}} |
| name: flyteconnector | ||
| description: A Helm chart for Flyte connector | ||
| type: application | ||
| version: v2.0.0 # VERSION |
| ports: | ||
| - name: {{ .Values.ports.name }} | ||
| port: {{ .Values.ports.containerPort }} | ||
| protocol: TCP | ||
| appProtocol: TCP |
Tracking issue
Why are the changes needed?
This PR completes the first pass of the flyteconnector chart migration to the new Flyte Connectors image/runtime.
What changes were proposed in this pull request?
pyflyte serve agentto the verified runtime commandflyte serve connectorHow was this patch tested?
Labels
Please add one or more of the following labels to categorize your PR:
This is important to improve the readability of release notes.
Setup process
Screenshots
Check all the applicable boxes
Related PRs
Stack
If you do use
git townto manage PR Stacks, the stack relevant to this PRwill show below. Otherwise, you can ignore this section.
Docs link